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Abstract 

Transport in near-integrable, but partially chaotic, l| degree-of-freedom 
Hamiltonian systems is blocked by invariant tori and is reduced at almost- 
invariant tori, both associated with the invariant tori of a neighboring integrable 
system. "Almost invariant" tori with rational rotation number can be defined 
using continuous families of periodic pseudo-orbits to foliate the surfaces, while 
irrational-rotation-number tori can be defined by nesting with sequences of such 
rational tori. Three definitions of "pseudo-orbit," action- gradient-minimizing 
(AGMin), quadratic-flux-minimizing (QFMin) and ghost orbits, based on vari- 
ants of Hamilton's Principle, use different strategies to extremize the action 
as closely as possible. Equivalent Lagrangian (configuration-space action) and 
Hamiltonian (phase-space action) formulations, and a new approach to visualiz- 
ing action- minimizing and minimax orbits based on AGMin pseudo-orbits, are 
presented. 

Keywords: Hamiltonian, Lagrangian, magnetic field, plasma wave 



1. Introduction 

Periodically forced 1-degree-of-freedom dissipationless physical systems are 
often called "1^ degree-of-freedom (d.o.f.)" systems 1 because their Hamilto- 
nian dynamics is best described in a 3-dimensional phase space (intermediate be- 
tween the 2-dimensional phase space of a 1-d.o.f. system and the 4-dimGnsional 
phase space of a 2-d.o.f. system). 

Two important applications of such 1^-d.o.f. systems in plasma physics are 
to describing one-dimensional single-particle motion in a modulated wave [U [3] 
and the "dynamics" of field lines in nonaxisymmetric toroidal magnetic fields, 
such as are required in the stellarator approach to fusion plasma confinement |4] . 
An important fluid-mechanics application is to description of passive advection 
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in planar, periodically stirred fluid flows JS]. There are many other applications, 
so we eschew application-specific notations in the main discussion. However we 
do, at appropriate points, relate the formalism to the context of the magnetic- 
field-line dynamics application as this has been the main motivation of this 
work. 

We use standard Hamiltonian dynamics notation except that we denote 
the generalized coordinate by 9 rather than g, assuming it to be an angle coor- 
dinate (in radians so 9/2tt £ S^), and we denote its conjugate momentum by 
/, rather than p {p and q being used instead as integers for defining rational 
fractions) . 

Also we denote the time-like independent variable by t, but it should be 
borne in mind that in the magnetic plasma confinement application it is not 
physical time but a toroidal angle [4], and the "periodic forcing" is simply the 
departure of the spatial dependence of the field from axisymmetry. Whether t 
is time or an angle, we assume 27r-periodicity and endow it with the topology 
of a circle, i/27r € S^. (However we lift the dynamics to its covering space by 
taking t G M. when more convenient.) 

The variables J, form polar coordinates in a 2-dimensional phase space, r2 
say. Assuming all motions of interest are bounded in momentum, / < /max, r2 
is topologically the product of a subset of the real line, [0,/max], and a circle. 
In li-d.o.f. systems it is often convenient to view the dynamical trajectories in 
an extended 3-dimensional phase space T3, by regarding time also as a phase 
variable. Topologically, as t is angle-like, Fs is the product of [0, /max] and a 2- 
torus. (In the magnetic field application I, 6, t label spatial points in K'^, defining 
a natural metric in the toroid embedded in K^, the dynamical trajectories 
corresponding to magnetic field lines and invariant tori to magnetic surfaces.) 

If a (time-dependent) canonical transformation, 1,9 1-^ J, Q, can be found 
such that the new Hamiltonian is autonomous, then the tori J = const are 
invariant under the dynamics and foliate — the system is integrable. While 
l|-d.o.f. Hamiltonian systems are generically not integrable, they may often be 
regarded as perturbed away from a neighboring integrable system (not neces- 
sarily known in advance). Then chaotic regions in the phase space, arising from 
homoclinic tangles associated with islands formed at rational rotation number w, 
may be separated by residual invariant tori with strongly irrational w. Trans- 
port is completely blocked by invariant tori, but even in chaotic regions it is 
not uniform [7], being slowed at transport barriers associated with "cantori," 
invariant cantor sets with strongly irrational rotation numbers. 

This paper concerns two approaches to defining almost-invariant tori joining 
invariant periodic orbits associated with phase-space islands. (We lose no gen- 
erality by restricting attention to periodic orbits as sequences of periodic orbits 
may be used to approximate cantori arbitrarily closely \8\ [9| fTO].) 

The general concept of almost-invariant sets acting as transport barriers has 
been discussed by Froyland and Padberg TT, who distinguish statistical and 
geometrical approaches to defining almost-invariant sets. The approaches we 
discuss are geometrical (in T3) and can be regarded as strategies for minimizing 
the action gradient. 
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In discrete-time area-preserving dynamical systems, candidate action-based 
definitions of "almost-invariant" are the quadratic-flux-minimizing (QFMin) 
topological circles introduced by Meiss and Dewar [121 [IHl [14] , and the ghost cir- 
cles described in the monograph of Gole [15 , and references therein. Analogous 
QFMin and ghost tori were also defined by Hudson and Dewar for Hamiltonian 
systems |16| in the context of magnetic field dynamics, but a unified Hamiltonian 
and Lagrangian formulation has not heretofore been presented. 

In this paper we give both Lagrangian (configuration space) and Hamilto- 
nian (phase space) formulations to make clear the similarities and differences 
of the two viewpoints. In Sec. [2] we set up the concept of pseudo-orbits and 
action gradient and in Sec. [3] we develop a new method for visualizing these 
concepts by reducing the dimensionality of the action extremization problem to 
2 through a partial minimization of the action. In Sec. [4] we develop the con- 
cept of almost-invariant torus through two different approaches to generating 
pseudo-orbits, ghost pseudo-orbits and pseudo-orbits that appear naturally as 
solutions to the Euler-Lagrange equation for the variational problem of mini- 
mizing the "quadratic flux" — the square of the action gradient integrated over 
angles. 



2. Dynamics and pseudo-dynamics 

2.1. Dynamics o/lj d.o.f. systems 

In terms of the Hamiltonian H{1 . 9, t), the dynamical system in is 

= Hi, (1) 
/ = -Hg, (2) 

1 = 1 (3) 

where Hj and Hg denote the partial derivative of H{-, •, •) with respect to its 
first and second arguments, respectively, and a dot over a phase variable denotes 
its total derivative with respect to a dummy time variable, r say. 

We assume Eq. ^ can be solved to give / uniquely as a function of 6, 9 and 
t so that the dynamics can be described equivalently by the Lagrangian 

L{9, 9, t) EE I{9, 9, t)9 - H{I{9, 9, t),9, t) , (4) 

in terms of which 

/ - , (5) 
Eq. Q then giving the Lagrangian equation of motion 

= Le , (6) 

where Lg and Lg denote the partial derivatives of L with respect to its first and 
second arguments, respectively. 



3 



Remark 1 (Twist condition). A necessary condition for the assumed unique- 
ness of I as a function of angular velocity 9 is that the velocity shear nowhere 
vanish within the system 

Hii^O. (7) 

// this condition is violated then I and L become multivalued. This case is of 
interest in both the passive advection JJ7| / and magnetic field contexts \18\/ . sug- 
gesting that the Hamiltonian approach is more appropriate than the Lagrangian 
in a wider range of applications. As the theory of almost invariant tori of the 
type we discuss in this paper has been predominately developed in a Lagrangian 
framework we present both formulations and avoid the "non-twist" issue by as- 
suming Eq. 

An invariant set of phase-space points is one that is mapped onto itself by 
the dynamics. In the following we consider two kinds of invariant geometric 
objects lying within T^: periodic (closed) paths and tori. 

The special case of an autonomous, 1-d.o.f. Hamiltonian system is integrable, 
meaning action-angle coordinates J, 6 can be found such that the Hamiltonian, 
K say, is a function only of J. Then the action J is a constant of the motion: 
J = —dK/dQ = 0. The level surfaces of J form a continuous family of invariant 
2-tori, nested about a closed invariant loop (periodic orbit) at J = and foliating 
the 3-dimensional J,Q,t phase space. 

In action-angle coordinates, J, O, the angular velocity is constant on each 
invariant torus: O = const(J). We call i-U(){J) = O the rotation number. (In 
magnetic plasma confinement it is called the rotational transform and denoted 
by t.) The number-theoretic properties of ujq are critically important for un- 
derstanding the effect of perturbation away from integrability, produced when 
the Hamiltonian becomes 

H ^ Ho{I) + eHi{I,e,t) , (8) 
to give a non-autonomous l^-d.o.f. system. 

Remark 2 (Restriction to rotational tori). Our interest in almost-invar- 
iant tori is motivated by a desire 119, to construct global phase-space 
coordinate systems of an action-angle type using a diffeomorphic canonical trans- 
formation from I, to J,Q phase-space coordinates. The desired transformation 
is to be continuously connected to the identity as e in such a way that some 
level sets of J coincide with invariant or almost-invariant tori. Because of this 
diffeomorphic restriction we restrict attention to rotational tori, i.e. tori con- 
tinuously connected to invariant tori of the unperturbed system, the terminology 
deriving from an analogy with the physical pendulum. Thus, for our purposes, 
even integrable perturbations can destroy invariant tori by creating "islands" 
containing invariant tori (librational tori) topologically different distinct from 



those of the unperturbed system (see Sec. 3.2] 



In order that Lagrangian and Hamiltonian approaches be completely equiva- 
lent we assume in this paper that Eq. \\\ is always enforced, 6 — Hi = 0, so that 
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Eqs. ^ and ^ are always valid. We also enforce Eq. ([3|, but to define almost- 
invariant tori we cannot use exact dynamics so we relax Eq. ([2| as described in 
detail below. 

2.2. Pseudo- orbits 

We start with some definitions: 

Definition 1 (Patii). A phase-space path is a curve in defined in the I,9,t 
covering space, [0,/max] x M x M, by 9 ~ / — I{t). A configuration-space 
path is the projection of the curve onto the 9, t covering space, M x M, defined 
by 9 = i){t). 

On a path, 9 = i9'{t), / ee I'{t). 

Definition 2 (Periodic path). A g) -periodic path, where p,q G 1 are mu- 
tually prime, is a closed path in for which the path functions iD and X obey 
the periodicity conditions 

dit + 27rg) = + 27rp , 

I{t + 2TTq) =I{t) yteR. (9) 

In the following we assume Eq. ([3| always to be satisfied, but distinguish 
different paths by the degree to which they satisfy the dynamical equations of 
motion: 

Definition 3 (Orbit). An orbit (periodic orbit) is a path (periodic path) for 
which all the Hamiltonian equations of motion Eqs. (0^^ are exactly satisfied 
[so, in particular, T' + Hg{I, i9, t) = OJ. 

In this paper we need objects, pseudo-orbits, lying between true orbits and 
arbitrary paths: 

Definition 4 (Pseudo-orbit). ^ pseudo-orbit (periodic pseudo-orbit) is a path 
(periodic path) on which Eq. ^ is satisfied exactly, but Eq. ^ is satisfied only 
approximately, X' + = 0(e). 

Remark 3 (Pseudo dynamics). The term "pseudo-orbit," is usedhere in the 
sense introduced by Dewar and Khorev {H^ , which is slightly different from, but 
in the spirit of, the normal usage in dynamical systems theory \2'A \2Sf . Specif- 
ically, we do not assume the error (i.e. the norm of the amount by which the 
dynamical equations fail to be satisfied) is bounded by e, but otherwise arbitrary. 
Rather, we assume the error is asymptotically 0{e), where e is a perturbation 
parameter measuring a departure from integrability. Also, we assume the er- 
ror terms are well-defined functions of the phase variables, giving a "pseudo- 
dynamics, " rather than arbitrary "noise. " 

It should also be realized there is no shadowing theorem in systems close to 
integrability as they are far from being hyperbolic. On the contrary, a pseudo- 
orbit may be 0(1) away from the closest true orbit. 
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Remark 4 (Hamiltonian/Lagrangian equivalence). As the first condition 
in Def. allows a unique Lagrangian to be defined via Eq. the second condi- 
tion defines a unique Lagrangian pseudo-dynamics dLg/dr — Lg = 0{e). Con- 
versely, as Eq. ^ defines X{t) uniquely, given 'd{t), configuration- space pseudo- 
orbits map one-to-one to phase-space pseudo-orbits. 

In future work it may be useful to allow a more general definition of pseudo- 
orbit in which Eq. ^ is only approximately satisfied, but we have imposed 9 — 
Hj = in this paper so that the Hamiltonian pseudo- dynamics we develop here 
is equivalent to the Lagrangian pseudo-dynamics we have previously used. 

2.3. Action gradients 

The action of a (p, g)-periodic configuration-space path 6 = ^{t) is defined 
as a functional of § by the integral 



2-Kq 



L{d,d',t) dt 



(10) 



Correspondingly, the phase-space action of a (p, (7)-periodic phase-space path 
e = d{t),I ^ I(t) is defined by 



Sphli},!] = / [Id' - H{I, t)] dt . 
Jo 



(11) 



The first variations are linear functionals of the variations, S'd{t) and 5X(t), 
of the path functions, 

SS=/5d,^-^y (12) 



and 




(13) 



where (/, g) denotes the inner product between arbitrary path functions / 
and g, 

{f,g)^ I fgdt, (14) 
Jo 

and denotes matrix transpose. Thus 5S/S9 and [SSph/50,SSph/SI]'^ may be 
regarded as infinite-dimensional action gradients. 



Varying and I in Eqs. (10) and (11), integrating by parts and comparing 

ificE 

dL, 



with Eqs. (12 1 and (13) we make the identifications 

SS 



60 dt 



(15) 
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and 

^ = . (17) 

Thus, comparing the above with Def. [3j we see that the action gradient vanishes 
on a true physical orbit. This is a statement of Hamihon's Principle — orbits 
extremize the action: SS — V S-d, SI. 

Definition |4] requires a pseudo-orbit to satisfy Eq. ([T]) exactly, which, com- 
paring with Eq. ( |16[ ) is the constraint on the phase-space action gradient 

^=0. (18) 

Therefore, [SSph/SO, 6Sph/SI] = [SS/S9,0] on a pseudo-orbit. Consequently, 
whether working in phase space or configuration space, we shall mean by the 
unqualified term action gradient the quantity 6S/56. 



3. AGMin pseudo-orbits and action contours 



The space of all possible paths is infinite-dimensional and thus the function 
iS* and its gradient 63/69 are difficult to visualize. Although, as described in 
Sec. 4.2 the gradient flow induced on a periodic orbit by 6S/69 forms a ghost 
torus in this only gives a partial picture of the nature of S. Instead, in 
this section we present a method for selecting a two-parameter family of (p, q)- 
periodic pseudo-orbits that includes the true (p, g)-periodic orbits at the minima 
and minimax points of S defined on this family. 





Figur e 1: Action contours (color online) for AGMin (1, 2)-periodic pseudo-orbits described in 
Sec. | |3.2[ l. (a) Left: the unperturbed case e = 0, in which there is a line of (1, 2)-periodic 
orbits at Iq = 1/2. (b) Right: perturbed case e = 0.002, in which all but two (1, 2)-periodic 
orbits, the action-minimizing and -minimax orbits, are destroyed. Also shown in (b) are rest- 
frame energy contours (red solid curves) to illustrate the fact that minimax/minimum points 
of action are minimum/minimax points of energy, respectively, and the set of starting points 
(solid green curve) used to illustrate the pseudo-invariant torus concept in Sec. |4.1| and its 
image (dashed green curve) under the return map. 



The method is based on selecting only pseudo-orbits that minimize the action 
gradient along a path in the norm, ||(5S'/(50|| = {6S/69, 63/69)^^^ > 0, where 
the inner product is defined in Eq. 
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Definition 5 (AGMin pseudo-orbits). Action-gradient-minimizing (AGMin) 
pseudo-orbits are paths that minimize the action- gradient norm \\SS/S9\\, which 
vanishes if and only if SS/S6 = on the entire path, i.e. on true orbits. 

3.1. Lagrangian variational principle for AGMin pseudo-orbits 

A (p, g)-periodic AGMin pseudo-orbit minimizes the AGMin objective func- 

1 fSS^" ^ 

2.L [J0 



tional 



dt 



(19) 



over (p, (7)-periodic paths dp^q{t). 
From Eq. (fTsl) 



.5S 



^ L 

= Lgo — 



5-3 + LggS^' 
dL 



dt 



dt 



d 
dt 



d< 



d 
dt 



(20) 



Substituting Eq. (20 1 and varying Eq. (19) we find, after integrating by parts 

SS 



l-2-lTq 






d" 


/ 5d 








JQ 


ir"" dt , 




'dt. 



S0 



dt 



(21) 



Setting Sfp^q = V 5i9 we find the Euler-Lagrange equation for AGMin pseudo- 
orbits 



Lee 



dL, 



dt 



dt 



-L; 



d 

'dt 



SS 



, Vt e [0,27rg] 



(22) 



where SS/S9 stands for the expression in Eq. (15). In Eqs. (21 1 and ( p2| the 
second-order time derivative term has been written in such a way that its self- 
adjointness is manifest, d/dt being regarded as an operator that acts on every- 
thing to its right except when its scope is hmited by being inside parentheses 
(...). 



From Eq. (15) we see that Eq. (22) is a fourth-order differential equation 



for i}. The four arbitrary constants in its general solution are to be determined 
from two initial conditions and two periodicity conditions (cf. Def. [2]) 



^(0) = 
z9'(0) = 

i9'(27rg) = 



9o + 27TP , 



(23) 



These boundary conditions ensure that the periodic extension to all t of the 



pseudo-orbit segment obtained by solving Eq. ( 22 ) satisfies continuity of ??(t) and 
'd'{t) Vt e M. However, for arbitrary ^o, ^"{t) will in general be discontinuous 
at t = 2nqk, fc e Z. 
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3.2. Action contours 

In Figure [T] we show two action-contour plots using the particle-in-wave 
Lagrangian/Hamiltonian 

L = + ecos(TO6' — nt) > ^ ^ ~^ — ecos{mO — nt) , (24) 

taking, specifically, to = 2, n = 1 (which also models a magnetic island at the 
i = 0.5 surface). The contours of the action were plotted for the 2-parameter 



family of (1, 2)-periodic AGMin pseudo-orbits: Setting p = 1, g = 2, Eq. (22 1 



under the boundary conditions Eqs. (23) was solved (using the Mathematica ^24j 



routine NDSolve), for an array of initial conditions a-nd — -^o a-nd plotted 
using Mathematical s ListContourPlot. 

Figure [ija) shows the unperturbed case, e = 0. In this case there is a 
horizontal valley of minima of S on the rational invariant torus /o = w = 1/2, 
which is foliated by a family of (1, 2)-periodic orbits (as SS ~ for each member 
of this family, all members must have the same value of S) . 

Figure [ijb) shows the case e = 0.002, where all but two of the a; = 1/2 
periodic orbits are destroyed because the action valley is not structurally stable 
under perturbation: the slightest ripple breaks it into minima and saddle points. 
Only two periodic orbits survive: the "minimax" orbit passing through the 
saddle points of S, which are seen to coincide with wave-frame-energy minima 
and hence this orbit is elliptically stable; and the "minimizing" orbits passing 
through the minima of 5, which coincide with the saddle points of wave-frame 
energy (red curves, see below) and are thus hyperbolically unstable. The green 
curves are explained in Sec. |4.1| 

By making a Galilean transformation to the wave frame the system in 



Eq. (24) can be made autonomous (it is isomorphic to the physical pendu- 
lum), and is thus integrable. The red solid curves in Fig. [ij^b) show energy 
contours in the wave frame and are thus t = sections of invariant tori, which 
are seen to be of two distinct topological types — "librating" orbits within the 
island separatrix, and "rotating" orbits outside the separatrix. There is no dif- 
feomorphic action-angle transformation continuously connected to the identity 
so this example, though integrable, is sufficient for illustrating the destruction 
of a primary invariant torus (see Remark [2|, specifically the torus with the res- 
onant rotation number u — n/m — 0.5. [Note that, unlike the (1, 2)-periodic 
pseudo-orbits used to construct the action-contour plots, each true orbit in gen- 
eral has a different rotation number.] 

The path-pseudo-orbit method thus provides a visualization of the Poincare- 
Birkhoff theorem 8], which shows that survival of a pair of minimizing and 
minimax orbits is generic after invariant torus with rational rotation number 
of an integrable system is destroyed by a perturbation that (in general) makes 
the system non-integrable. The minimizing and minimax orbits thus make a 
robust framework on which to build a theory of almost-invariant tori, as shown 
in Sec. [H 
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0.40 




Figure 2: Three-dimensional plots (color online) of action S vs. Io,9q for AGMin (3,8)- 
periodic pseudo-orbits, computed in the same way as the pseudo-orbits in Fig. [T] for the 
nonintegrable Hamiltonian defined in Eq. ( |33[ l and following text, (a) Left: Top view showing 
the nonlinearly deformed "action valley" corresponding to the almost-invariant torus with 
Lo = 3/8. (b) Right: Bottom view showing that the valley floor is almost level. 



3.3. Hamiltonian variational principle for AGMin pseudo-orhits 

In the alternative Hamiltonian phase-space formulation we introduce a La- 
grange multipher \{t) to take into account the constraint imposed by Eq. (18), 
which is difficult to implement explicitly. Then, to define (p, g)-periodic AGMin 
pseudo-orbits we extremize the functional 



/php,g[2:,i?. A] = / 
Jo 



1 (5S^ 

2 \ 59 



A 



5S, 



ph 



51 



dt 



under independent variations of I and d. Varying Eqs. (16 1 and (171 
)-5S-p\i 



60 
SSph 
51 



= -51' - Hj05I- Haf,5d 



= 5^' - Hu5I~ HiB5d , 



(25) 

(26) 
(27) 



where X' denotes 1'{t). Using these expressions and varying Eq (25) we find 

d „ \ (55, 



6fphp.q 



27Tq 

dtUx 



dt 



H 



18 



ph 



XH 



II 



5d 



5S, 



ph 



d 
di 



Hie A 



Requiring 5fph = y 5X, 5'd gives the two Euler-Lagrange equations 



dt 



H 



le 



-Hf, 



5S, 



ph 



5Sph 
56 
d 

dt + 



XHii 
Hie I A 



0, 
0, 



(28) 

(29) 
(30) 
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where SSph/S9 stands for the expression in Eq. (16). 

These comprise one second-order and one first-order ordinary differential 
equation. With the constraint Eq. (18), which is a first-order o.d.e., we have 
three equations for the three dependent variables, X and A. As we assume 
the twist condition Eq. ([t]) we can eliminate A between Eqs. (29) and Eq. (301 
and replace them with the single third-order o.d.e. 



Ho. 



6S, 



ph 







(31) 



The four arbitrary constants of the general solution are to be determined 
from the initial conditions and periodicity, 



1(0) 

m 

I{2TTq) 



— &0 , 

= Oo + 



2Trp . 



(32) 



It is readily verified that the Hamiltonian pseudo-orbit defining equations 
Eq. ( [Tsl , Eq. (31) and Eqs. (32) are equivalent to the Lagrangian defining 
equations Eq. (l22F and Eqs. (|23|). 



Figure [2] shows action plots for a particle in two waves (or field lines af- 
fected by islands on two rational surfaces), which is a nonintegrable system 
with Hamiltonian ^ 

H=^-+eVi9,t), (33) 

where V{9,t) = —(1 — S) cos{mi9 — nt) — Scos{m29 — nt). Specifically, we take 
n = 1, TOi = 2 and m2 = 3, which excites resonant islands at w = 1/2 and 
1/3, and take 5 = 0.5, e = 4 x 10^^. In the boundary conditions Eq. (23) or 
Eq. (32) we take p = 3, g = 8 so the path-pseudo-orbits have rotation number 
uj — 3/8 = 0.375. This fraction is a close rational approximant to the noble 
number 1 — 7"^ = 0.381966..., where 7 = (1 -I- V5)/2 is the golden mean 
(cf. Fig. 6 of Ref . [T3l) . The AGMin pseudo-orbit defining equations were again 
solved using Mathematica's NDSolve, but in Fig. [2] the results are displayed 
using ListPlotSD. 

As the invariant torus at w 1 — 7^^ is very robust it should survive up to 
e = 0(1) so the pseudo-orbits of the neighboring lu = 3/8 almost-invariant-torus 
should all satisfy SS ^ for the small value of e we use. Thus the fioor of the 
action valley should be almost level, as is observed, illustrating the potential of 
AGMin pseudo-orbits as a visualization tool for illustrating the Kolmogorov- 
Arnold-Moser (KAM) theorem [HI US] and testing the existence of KAM tori. 



4. Almost-invariant tori 

4.1. Pseudo-invariant tori 

To generalize the concept of invariant torus, we consider a 1-parameter family 
of {p, 5)-pcriodic pseudo-orbits i3{t\9o), 27r-periodic in 9a, such that d{0\9o) = 9a- 
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Figure 3: Illustration of the covering of a torus using a subset of the e = 0.002 AGMin (1,2)- 
periodic pseudo-orbits described in Sec. |3] and plotted using Mathematica's ParametrlcPlot. 
(a) Left: pseudo-orbit set described below plotted in the 0,t covering space, (b) Right: the 
same set applying torus topology. 

The almost-invariant tori studied in this paper are specifically those that can 
be built from from these pseudo-orbits. 

However, before giving the full construction we first single out the pseudo- 
orbit starting at 6*0 = and consider the set formed from its images under the 
return map: {i?(27rj|0) mod 27r|j — 0,1, . . . , q — 1}. We then rearrange this set 
to form the ordered set {0^"^ = 0, 9^o\ 6*^'"^'}, 0^^^ < 61*,*+^' and extend it 

by defining oj^'^'^ = 2it [as i){2iTq\0) and 19(010) are topologically equivalent by 
Eq. 

Recalhng that Def. [4] requires Eq. ^ to be satisfied, we can use Eq. ^ to 
determine / and define a 

Definition 6 (Pseudo-invariant torus). A pseudo- invariant torus 7^,g['i?] is 
a surface swept out in by a family of {p,q) -periodic pseudo-orbits 

t — T mod 27T , 

e = i9(t|6Io) mod 27r , 

/ = Lg{d{T%),Ar'd{T%),T) Vre [0,2^(7) (34) 
as 00 varies over the range 

where O^p is the first nonzero member of the ordered set of return points defined 
above. 

In the above Ar = d/dr denotes the time derivative along a given pseudo- 
orbit, i.e. with ^0 fixed. By restricting the range of 6q we create a helical ribbon 
which, after wrapping around the torus q times covers it completely. This is 
illustrated in Fig. [s] using a set of (l,2)-periodic AGMin-pseudo-orbits having 
the set of initial values shown by the solid green sinusoidal curve in Fig. Iljb). 
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The dashed green sinusoidal curve in Fig. [TJb) shows the image of the solid 
curve under the return map — taken together these two green curves cover the 
interval G [0, 2n]. 

Note that the set of pseudo-orbits has been selected to include the minimizing 
and minimax true orbits as this is a natural feature of an almost-invariant torus 
(see Sees. 4.2 and |4.3[). However this is not an essential feature of a pseudo- 



invariant torus, nor is the use of AGMin pseudo-orbits. 

For simplicity (but see Remark [5] below) assume the configuration-space 
paths do not intersect in the 9,t covering space, so the map : is a 

diffeomorphism for any value of t. As i?(i|6'o) increases monotonically with do, 
when t — 0, this remains true for all time: 



>oyt 



(35) 



Also, / is a single-valued function of Oq and t and we can invert i? to make / a 
graph over 9 and t. That is, we can find a single-valued function p such that 
/ = pi9,t). This is illustrated in Fig. [I) 




Figure 4: Illustration of the graph / = p(9, t) corresponding to the pseudo-orbits in Fig.jsjplot- 
ted using Mathematica's ParametricPlotSD to show embeddings into using two mappings: 
(a) Left: A simple Cartesian representation x = t, y = 6, z = I. (b) Right: A 3D polar-like 
representation x = [1 + p{6, t) cos 8] cos t , [1 -|- p{0, t) cos 9] sin t, z = p{8, t) sin 6, analogous to 
an almost-invariant torus in magnetic-field-line flow. 



Equations ( 34 ) clearly show that foliation by a given pseudo-orbit family is 
sufficient to specify a torus. Conversely, specification of an arbitrary trial torus 
T € implies a natural vector field in the tangent space at each point on the 
torus that locally defines a family of pseudo-orbits via a dynamical system. To 
see this, define T via a graph (for simplicity, but see Remark [5| of / over the 
9, t covering space M x M 

T[p\ : / = p{9, t) V 6*, t e M , (36) 

where p is a 27r-periodic function of 9 and t. Combined with Eqs. ([!]) [implied 
by the constraint Eq. ( 18 )] and ([3| this implies the following two-dimensional 
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vector field 



[0, i](e,t) = [Hi{p{e,t),e,t), i] 



(37) 



Remark 5 (Graph property). The assumption in Eq. (36) that p is a graph, 
i.e. single valued, is convenient but not strictly necessary. Following Dewar and 
Meiss USf and Dewar and Khorev JJ^[ / we could relax this assumption by semi- 
conjugating 6 to a linearly time- dependent family of rotations: 9 — 19(00 + ujt), 
which also puts the case of irrational lj on the same footing as the rational case. 
For simplicity we shall not pursue this approach further in the current paper, 
but it is sometimes found to be necessary for QFMin tori, as they are not always 
graphs over the angle coordinates 9 and t. Ghost tori on the other hand, have, 
at least in the case of area-preserving twist maps, been proven to possess the 
graph property J15f . 

EUminating r in favor of t yields a nonlinear, first-order o.d.e. defining a 
family of solutions 9 = 'd{t\9o), parametrized by the initial values 

dtm^o) = Hi{p{'d(t\9o),t), d{t%), t) . (38) 

Thus we can define a phase-space pseudo-orbit 6* = ?9(t|6'o), I — X(i|6'o) = 
p{'d{t\9o),t) passing through each point of T. 



Remark 6 (Condition for foliation). Integrating Eq. (38) once around the 
torus defines the circle map 9o i— >■ i9(27r|0o)- Circle maps with rational rota- 
tion number generically have a singular invariant measure because of the phe- 
nomenon of Arnold tongues \25^ . Thus the pseudo-orbits on an arbitrary torus 
do not in general smoothly foliate it. However, the Euler-Lagrange equation 
that will be derived in Sec. \4.3.S\ for a QFMin torus generates pseudo-orbits 
that foliate of the torus smoothly so no inconsistency is generated by assuming 
such foliation from the outset. 



4.2. Ghost tori 

As illustrated in Fig. [l] when an invariant torus with rational rotation num- 
ber is destroyed by a perturbation, two true orbits with the same rotation 
number survive: an "X-point" orbit that is a minimum of S, and an "0-point" 
orbit that is a minimax (saddle) point of S. The ghost-curve strategy is to join 
these two periodic orbits by a family of pseudo-orbits, labeled by a continuous 
parameter T{9o), generated by flowing down the action gradient from minimax 
orbits to minimizing orbits. Below we describe this in configuration space and 
phase space. 

4-8.1. Ghost torus — Lagrangian approach 

In configuration space the gradient fiow equation is 

Di9 _ 1 d-d _ SS 

DT " T'{9o) ~ ^J9 ■ ^ ' 
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This flow evolves a function, defined on the infinity of points on the inter- 
val t S [0, 27rg]. Furthermore, values at different t are coupled because SS/S9, 
defined in Eq. (15), involves first and second time derivatives of i?. The prob- 



lem is thus infinite-dimensional, but a discretized approximation can be solved 
numerically in a straightforward fashion [10] . 

The function T(6q) is not known a priori but, once "d is found as a function 
of T, it may be calculated by integrating 



5S 



(40) 



which follows from Eq. (39) when it is recognized that d'd{Q\9Q) / dOo = 1. Be- 
cause 6S/S9 = at the minimizing and minimax periodic orbits, T varies be- 
tween =pcx). 



4-2.2. Ghost torus — Hamiltonian approach 

In phase space, pseudo-orbits are defined as in Def. ^ and we thus need 
to evolve both -d and I with respect to T. The former is still evolved by the 
action-gradient flow 

^ = (41) 
DT 69 ' ^ ' 

but, to maintain equivalence with the Lagrangian formulation, the constraint 

Eq. (18) must be used in the form DT{6Sph/6I) = DT(diz9 — Hj) = 0, where 

df = d/dt and = D/DT. As t and T are independent variables, we can 

interchange the order of df and Using Eq. ( [4l| ), we find the evolution 

equation for I 



DI 
DT 



1 



H 



le 



d_ 
dt 



5S, 



ph 



(42) 



Interestingly, the right-hand side of Eq. ( 42 ) is seen from Eq. ( 29 ) to be the 
Lagrange multiplier A arising from the AGMin construction. However, Eq. (30) 



is not consistent with Eq. (41 ) so ghost pseudo-orbits are not a subset of AGMin 
orbits. 



4.3. QFMin tori 

We now define functionals ipi and ip2 as surface integrals of powers of the 
action gradient over T 



^2 



ss 



d9dt 



(43) 
(44) 



It can be shown [see Eq. (51) below] that the surface integral linear in the 
action gradient vanishes identically, i.e. ipi = 0, which supports the interpre- 
tation of ipi as the net flux of extended phase space volume across I. (In the 
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case of magnetic fields this is the net magnetic flux [TB], which is zero because 
of the absence of magnetic monopoles.) 

Thus we must go to the "quadratic flux" > before having a nontrivial 
measure of the invariance of T under the dynamics (equality to zero applying 
when 68/66 = on T, i.e. if and only if it is an invariant torus). The quadratic 



flux is the analogue of the objective functional Eq. ( 19 ) for action-gradient- 
minimizing (AGMin) pseudo-orbits, but with the norm defined on tori rather 
than paths. Analogously, we define a quadratic-fiux minimizing (QFMin) torus 
as follows. 



Definition 7 (QFMin torus). A QFMin torus T is one that minimizes ip2- 



4-3.1. QFMin torus — Lagrangian approach 

In the Lagrangian approach we define the trial torus T['d] in terms of ar- 



bitrarily variable pseudo-orbits using Eq. (34), which requires Eq. (44 1 to be 



modified due to the change of variable 9 i-^ 6o, giving the alternative Lagrangian 
definition 



^2 



2wq 

dt 



dWo 

(0) 



2iT 9-1 
dt^ 





2tt 



2=0 



d^o 



6S 



d'd f6S 



dOo \60 



6S\ di} 



69 J d6o 



d9odt 



(45) 



the manipulations required to arrive at the latter form being based on the 

(i) 

assumption that the integrand is periodic in 9o and t, and the endpoints 9q 
being members of the ordered set of return points of the orbit starting at 9q = 
defined at the beginning of Sec. |4.1| 



Varying Eq. ( 45 1 and integrating by parts to remove the 9q derivative from 



61!}, we find the first variation 



6ip2[-&^ 



p,gi 



6S 



d^J6S\ d f6S 

d9,\T9)-^^W, 



d9odt . 



(46) 



With ^0 as an independent variable, the total time derivative along a pseudo- 



orbit, dt = d/di, is d/dt^ which commutes with 8/39^. Thus we can use Eq. (20l 
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to evaluate both terms in Eq. ( 46 ) . The terms not involving dt cancel, leaving 



dS r di9 



69 



II 



-S^dt 
dd 



fdL. 



\ dt 



- dt (LggSd) 



dt 



d0~o 



S^dt 



(M_ 
Wo 



SS 



(47) 



where the second form is obtained after integration by parts in t, leading to 



multiple cancellations, and we assumed Eq. (35) to justify dividing by d-d/dOo- 
Equating 6ip2 to zero for all St!} yields the Euler-Lagrange equation for the 
periodic pseudo-orbits making up a QFMin torus 



d 
dt 



d SS 
dtJd 



0, 



(48) 



where we have reverted to the equivalent notation d/dt for the time derivative 
along a given pseudo-orbit (i.e. 9q fixed). Remarkably, and unlike the Euler- 
Lagrange equations for AGMin pseudo-orbits, this equation may be analytically 
integrated to give the action gradient on the QFMin-torus pseudo-orbits. 



SS^ 



dt' 



(49) 



where n{0o) and ^{Oo) are constants of integration. Assuming the twist condi- 
tion, Eq. ([t]), Lgg = l/Hji 7^ 0, so the second term is monotonically secular 
in t unless fi = 0. However SS/S0 is evaluated on a periodic pseudo-orbit so it 
must be periodic, implying fj, — is the only allowed choice. The meaning of 
the remaining constant, v, will be discussed further below after we derive the 
same equation using a Hamiltonian approach. 

4-3.2. QFMin torus — Hamiltonian approach 



Consider a trial torus T[p\ as defined in Eq. (36). Using Eqs. (36) and (37) 



we define a Hamiltonian vector field on the 9, t plane 

[0, i]{e,t)=[Hi, pt+Hipe] 



(50) 



where Hi denotes Hj{p{9,t),9,t), and pt and pe denote the partial derivatives 
of p{9, t) with respect to t and 9. 

Using Eq. (50) to eliminate 9 from Eq. (17) we have 6Sph/5I = and. 



eliminating / from Eq. ( 16 ), 5S/S9 = SSph/59 becomes a scalar field on the 9, t 
plane 

SS 



= -(Pt+Hipg) 

= -pt - ^bH , 



H, 



(51) 
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where Hg denotes Hg{p{9,t),0,t), whereas BgH denotes the total 9 derivative, 

Hg + Hipg. 

The QFMin approach to defining almost-invariant tori is to minimize ip2 
over arbitrary deformations of T. Thus we consider infinitesimal deformations 



generated by variations dp{9, t). From Eq. (51 ) 



6 S 

= -Spt - Bg{HiSp) 

da 



(52) 



Using this result in the first variation of Eq. ( 44 ) and integrating by parts we 
find 



27r 



6ip2 



5pd, [ ^) d9dt 



(53) 



where dt denotes dt + HjBg. 

Equating dip2 to zero for all variations Sp gives the Hamiltonian analogue of 



Eq. (48) 



(54) 



Integrating Eq. ( 54 1 along the path defined by Eq. ( 38 ) gives Eq. ( 49 ) with p = 0. 
Thus, using either the Hamiltonian or the less elegant Lagrangian approach, we 
are led to 

Definition 8 (QFMin pseudo-orbit). A QFMin pseudo-orbit is one satisfy- 
ing the constraint Eq. (18) and the modified Hamiltonian or Lagrangian equa- 
tion of motion 

SS 

where i'{9o) is constant along each pseudo-orbit. 



(55) 



Then the desired QFMin torus is constructed by varying v continuously over its 
range so as as to sweep out T by QFMin orbits foliating the surface. Note that 
V — Q on the action-minimizing or -minimax orbits of an island chain, so these 
are automatically incorporated into T as in the ghost-orbit construction. 

For low-order periodic orbits in a system close to integrability, i.e. for which 
Eq. ([s]) applies, v — 0{e) and a perturbation expansion can be used. Numer- 
icall y, a. QFMin torus with to = p /q m ay easily be found }16) by integrating 
Eq. (55), with the constraint Eq. (18), given initial values 6*0 and Iq (or 9q) 
on the Poincare section t — and a guess for i^. Holding 6*0 fixed, i' and Iq 
are adjusted iteratively in a two-dimensional search until a {p, g)-pseudo-orbit 
satisfying the periodicity conditions Eqs. (|9| is found to the desired accuracy. 
As this procedure can be carried out for all ^o, the desired foliation of the torus 
is achieved. 
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5. Conclusion 



We have reviewed equivalent general Lagrangian and Hamiltonian action- 
based formulations for defining and calculating almost-invariant tori based on 
the concept of pseudo-orbit. In previous work [10) we have found the QFMin 
approach to be easier to implement numerically, but the ghost surface approach 
is more satisfactory in that the graph property is preserved for high-order orbits 
and high nonlinearity (cf. Remark [5]). Some open issues are: 



Can we unify the rational-oj QFMin and ghost surface approaches for 
arbitrary nonlinearity through an appropriate change of coordinates ^5] ? 

If so, can irrational-w unified tori be defined as the limit of a sequence 
of p, g-almost-invariant tori up to and beyond the breakup of the corre- 
sponding invariant torus? (In which case the quadratic flux could be used 
as an alternative to Greene's residue [27] for determining existence as well 
as a measure of transport through the cantorus beyond breakup.) 

We can also define an "AGMin" pseudo-invariant torus by replacing the 



boundary conditions ?9'(0) = 6*0 and ?9'(27rg) ^ 0a in Eq. ^ with ?5'(0) = 
'd'{27Tq) and i^"(0) — d"{2nq), so that 6q is selected to make the pseudo- 
orbits analytic for all t and 9q. What are the properties of such a torus? 

• Can we usefully widen the allowed class of phase-space pseudo-orbits by 
relaxing the constraint Eq. (18)? 



Can we further generalize the phase-space pseudo-orbits by using non- 
canonical approaches? 
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